Learning Rate Optimization for Federated Learning Exploiting Over-the-Air Computation

نویسندگان

چکیده

Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed at devices model aggregation in central server. In order to enable efficient wireless data aggregation, over-the-air computation (AirComp) has recently attracted great attention. However, fading of channels produce aggregate distortions an AirComp-based FL scheme. this paper, we propose modified federated averaging (FedAvg) algorithm introducing local rates present convergence analysis. To combat distortion, rate is optimized adapt channel, which termed dynamic (DLR). We begin our discussion considering multiple-input-single-output (MISO) scenario, since underlying optimization problem convex closed-form solution. Our studies are extended more general multiple-input-multiple-output (MIMO) case iterative method derived. also asymptotic analysis give near-optimal receive beamforming solution when number antennas approaches infinity. Extensive simulation results demonstrate effectiveness proposed DLR scheme reducing distortion guaranteeing testing accuracy on MNIST CIFAR10 datasets. addition, close-form verified through numerical simulations.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Stochastic, Distributed and Federated Optimization for Machine Learning

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear convergence for strongly convex objectives. Second, we study distributed setting, in which the data describing the optimization problem does not fit into a single c...

متن کامل

Federated Optimization: Distributed Machine Learning for On-Device Intelligence

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a high-quality centralized model. We refer to this setting as Federated Optimization. In this setting, communication efficiency is of the utmost importance and minimi...

متن کامل

Federated Meta-Learning for Recommendation

Recommender systems have been widely studied from the machine learning perspective, where it is crucial to share information among users while preserving user privacy. In this work, we present a federated meta-learning framework for recommendation in which user information is shared at the level of algorithm, instead of model or data adopted in previous approaches. In this framework, user-speci...

متن کامل

the effects of integrating cooperative learning into vocabulary learning of elementary school students

the purpose of the research is to examine if integrating cooperative learning into vocabulary learning helps to increase word recognition of students in an elementary school in iran. it tries to investigate whether cooperative learning approach enables students to improve their language learning. this research used stad (students team achievement division) as a cooperative model in this study. ...

15 صفحه اول

the relationship between using language learning strategies, learners’ optimism, educational status, duration of learning and demotivation

with the growth of more humanistic approaches towards teaching foreign languages, more emphasis has been put on learners’ feelings, emotions and individual differences. one of the issues in teaching and learning english as a foreign language is demotivation. the purpose of this study was to investigate the relationship between the components of language learning strategies, optimism, duration o...

15 صفحه اول

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Journal on Selected Areas in Communications

سال: 2021

ISSN: ['0733-8716', '1558-0008']

DOI: https://doi.org/10.1109/jsac.2021.3118402